Systems and Methods for Automated Analysis of Cells and Tissues 

Under 35 USC §1 19(e)(1), this application claims the benefit of prior U.S. provisional 

application , filed April 19, 2001, and U.S. provisional application 60/334,723, 

filed October 31, 2001, the contents of which are incorporated herein by reference. Work 
described herein was supported in part by funding from the National Institute of Health. The 
U.S. Government may therefore have certain rights in the invention. 

1. Background of the Invention 

Tissue microarray technology offers the opportunity for high throughput analysis of 
tissue samples (Konen, J. et ah, Nat Med. 4 :844-7 (1998); Kallioniemi, O.P. et al, Hum. MoL 
Genet. 10 :657-62 (2001); Rimm, D.L. et al, Cancer J. 7 :24-31 (2001)). For example, the ability 
to rapidly perform large scale studies using tissue microarrays can provide critical information 
for identifying and validating drug targets/ prognostic markers (e.g. estrogen receptor (ER) and 
HER2/neu) and candidate therapeutics. 

Automated quantitative analysis of tissue samples in microarrays, however, presents 
several challenges, including heterogeneity of tissue sections, subcellular localization of staining, 
and the presence of background signals. For example, depending on the type of tumor or tissue 
section being analyzed, the area of interest may represent nearly the entire sample, or only a 
small percentage. For instance, a pancreatic carcinoma or lobular carcinoma of the breast with 
substantial desmoplastic response may show stromal tissue representing a large percentage of the 
total area. If the goal of the assay is to determine epithelial cell expression of a given marker, a 
protocol must be used that evaluates only that region. The protocol must not only be able to 
select the region of interest but also normalize it, so that the expression level read from any given 
area can be compared with that of other areas. Subcellular localization presents similar 
challenges. Comparisons of nuclear or membranous staining, for example, are quite different 
from those in total cytoplasmic staining. 
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Certain methods (including confocal and convolution/ deconvolution microscopy) have 
been used to quantify expression of proteins at the cellular (or sub-cellular) level within a single 
high power field (Robinson, J.P. Methods Cell Biol. 63 :89-106 (2001); Shaw, P. Histochem. J. 
26:687-94 (1994)). However, these are computationally intensive and laborious techniques, 
5 which operate on multiple serial images. As a result, the current standard for analysis of tissue 
microarrays, like tissue sections, is conventional pathologist-based analysis and grading of the 
sample according to scale. 

Most biomarkers exhibit a parametric (normal, "bell-shaped") distribution, and 
consequently are best analyzed by a continuous scale (e.g., 0 to 1000). Unfortunately, manual 
f{\ 0 observation tends to be nominal (e.g. 1+, 2+, 3+), primarily because the human eye in unable to 
W reliably distinguish subtle differences in staining intensity. Several methods have been 

in 

ff j developed to translate nominal manual observations into a continuous scale. Foremost among 

jp! these is the H-score where the percent of positively stained cells (0 to 100) is multiplied by the 

PI staining intensity (e.g. 0 to 3) to make a theoretically continuous scale (0 to 300). However, the 

f |1 5 inability to detect subtle differences in staining intensity, particularly at the low and high ends of 

Ft I 

H\ the scale, as well as the tendency to round scores (e.g.. 50% at 3+ for a score of 150, versus 47% 

M at 3+ for a score of 141), limits the effectiveness of the H-score. 

Automated systems and methods for rapidly analyzing tissue, including tissue 
microarrays, that permit the identification and localization of identified biomarkers within tissues 
20 and other cell containing samples, are needed. 

2. Summary of the Invention 

In one aspect, the invention features systems and methods for rapidly analyzing cell 
containing samples to localize and quantitate particular biomarkers within cells. In one 
embodiment, the method is implemented by a computer and superimposes an image of the 
25 biomarker against an image of a user defined area within the cell to determine whether the 
biomarker is within the user defined area. 
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In another aspect, the invention features an algorithm that facilitates the optical analysis 
of an array of biological samples, despite image irregularities, distortions, varying topologies, 
and the absence of one or more elements. 

Analysis of patient samples according to the systems and processes described herein can 
be useful diagnostically (e.g. to identify patients who have a particular disease, have been 
exposed to a particular toxin or are responding well to a particular therapeutic or organ 
transplant) and prognostically (e.g. to identify patients who are likely to develop a particular 
disease, respond well to a particular therapeutic or be accepting of a particular organ transplant). 
As new and better markers of disease become identified in the post-genomic era, the instant 
described processes, which not only quantitate the markers, but also determine their relative 
location within a cell, will increase in applicability. 

Automated analysis of cell containing preparations, as described herein, can provide a 
rapid assessment of the prognostic benefit of biomarkers. In addition, these automated 
techniques can identify associations that are typically not revealed using manual techniques. 
Also, automated analysis can better discern subtle differences in staining intensity, particularly at 
the upper and lower extremes. The ability to detect low level expression and distinguish it from 
no expression can provide important prognostic information. Furthermore, analysis of the sub- 
cellular distribution of certain biomarkers may elucidate previously unrecognized associations 
with patient survival. 

Other features, objects, and advantages of the invention will be apparent from the 
following figures, detailed description and claims. 

3. Description of the Figures 

FIG. l(A-D) shows separate monochromatic images of a colon carcinoma taken after 
staining with fluorescently-tagged markers and combined into a single color image as follows: 
DAPI (to visualize nuclei, blue), anti-cytokeratin (to distinguish tumor from non-tumor elements, 
green), and anti-alpha-catenin (to visualize cell membranes, red). 

FIG. 2(A-D) shows a regression comparison of automated and pathologist-based scoring 
of estrogen receptor levels. 



FIG. 3 is a flowchart of a method for identifying and accounting for the relative location 
of spots within an array. 

FIG. 4 is a flowchart of a process for localizing a signal (e.g. a biomarker) within a 

locale. 

5 FIG. 5 shows a tissue microarray. 

FIG. 6 shows an optical microscope station. 
4. Detailed Description 
P 4.1 General 

ft i In general, described herein are a collection of techniques that can be used for rapid, 

W O automated analysis of cell containing samples, including tissues and tissue microarrays. While 
pi these techniques build on one another and are described as a cohesive process, each technique 

U has wide applicability and may be used individually or in combinations other than those 
ft j described below. 

p In one embodiment is featured a technique to identify the location of spots within an 

n kd image. The technique, termed "spotfinder", can flexibly identify such locations despite image 
irregularities, distortions, varying topologies, and the absence of one or more elements. 
Although the process is described for locating the position of histospots and identifying missing 
histospots within tissue microarray images, the technique has broader application. More 
specifically it can be used to locate elements and identify missing elements in any collection of 
20 elements. Moreover, the process can be used on arrays of virtually any dimension and 

comprising a variety of elements. The specimens are not limited by size or shape, nor must they 
be regularly spaced. 

In another embodiment is featured a technique that can be used alone or in conjunction 
with spotfinder to optically localize and quantitate a biomarker within a cell. Though an image 
25 of a cellular preparation typically features two dimensions, cellular preparations feature depth. 
For example, one cellular feature may rest atop another. This overlap can potentially confuse 
image analysis software. A technique described herein, dubbed RESA (Rapid Exponential 
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Subtraction Algorithm), can approximate a three dimensional image by subtracting out-of-focus 
image elements. Thus, the impact of background features on an image can be reduced, 
permitting better image analysis. 

Another technique described herein, dubbed PLACE (Pixel Based Locale Assignment 
Compartmentalization of Expression), distinguishes between different cellular characteristics. 
For example, the technique can determine the location of subcellular compartments within 
individual cells. A computer implementing this technique can, for instance, measure the relative 
intensities of images derived from compartment-specific stains on a pixel-by-pixel basis. The 
computer then determines for individual pixels within an image, the likelihood that the pixel 
corresponds to a particular locale or user defined area within the cell. Such analysis permits the 
computer to assign signals to a sub-cellular compartment with an established degree of accuracy 
(e.g., 95%). The technique can co-localize signals associated with particular biomarkers with 
images of defined locales within cells. 

Use of these techniques can enhance both the speed and accuracy of automated 
microarray analysis. Figure 1 shows separate monochromatic images of a colon carcinoma taken 
after staining with fluorescently-tagged markers and combined into a single color image as 
follows: DAPI (to visualize nuclei, blue), anti-cytokeratin (to distinguish tumor from non-tumor 
elements, green), and anti-alpha-catenin (to visualize cell membranes, red) (panel A). Note the 
significant degree of overlap between the subcellular compartments. A monochromatic image of 
the biomarker (3-catenin, is taken (panel B, inset) and the intensity of each pixel in the image 
redistributed according to the relative signal intensity of the various compartments in panel A 
(blue= nuclei, red= membrane, green ~ cytoplasm). 

Although the p-catenin expression in this tumor is predominantly membrane-associated, 
the significant overlap in compartments in panel A incorrectly assigns a significant amount of the 
signal to the nucleus (magenta and blue pixels, panel B). To aid in the removal of overlapping 
signals, the monochromatic image of each sub-cellular compartment is exponentially subtracted 
from an out-of-focus image. Panel C shows a composite of the exponentially subtracted images 
of DAPI and anti-alpha-catenin (blue and red, respectively), shown on a mask derived from the 
anti-cytokeratin mask (green pixels). Pixels with too much overlap between channels are 
negated (<5%), as are non-tumor areas, as defined by a mask generated from the anti-cytokeratin 



image. In panel D, the signal intensity from an exponentially subtracted image of the biomarker 
(p-catenin, inset) is then redistributed according to the compartments defined in panel C. This 
results in more accurate assignment of the biomarker to the membrane compartment, which can 
have important prognostic significance. Since membrane-associated beta-catenin stabilizes 
5 cadherin-mediated adhesion by facilitating the cytoskeletal attachment of adhesion complexes, 
while nuclear-associated beta-catenin acts as a transcription factor, which up-regulates several 
genes important in cell proliferation and invasion and is considered an oncogene in this capacity, 
expression of beta-catenin alone does not provide prognostic information. However its 
localization in the nucleus can be an important indicator of carcinogenesis. 

;p0 1. Spot-finder 

CH In one embodiment, shown in FIG. 3, the computer removes Bl any atypically sized 

p spots from the image. Atypically sized spots may include, for example, images of fused spots 

jgj and/or debris. The computer performs the process automatically, though in other embodiments it 
may allow use of user input to facilitate the process. 

*3 5 The computer then creates or accesses an opaque virtual mask that is the size and shape 

M of a typical spot. Using the virtual mask, the computer scans B2 the image to determine B3 
f _4| where the mask first covers an area with the highest average pixel intensity. The computer 

monitors the total intensity of the image during the scan and, because the mask is opaque, 

identifies the position of the mask when the total image intensity is minimized. The computer 
20 identifies this area as the first spot and sets B4 the pixels within this area to have zero intensity. 

The computer also sets additional pixels within a predefined area around this area to have zero 

intensity. This helps to differentiate between overlapping spots. 

After identifying the first spot, the computer again scans B2 the image using the mask to 
find the next area with the highest average pixel intensity. When the next area is found, the 
25 computer identifies it as the second spot and sets the pixels in and surrounding this area to have 
zero intensity. The computer repeats this process until it can no longer find areas of the image 
with sufficient intensity to qualify as spots. 
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The computer then identifies B5 a reference point (e.g., the center) in each spot, and 
draws a line connecting the reference point of each spot to each nearest neighboring spot 
reference point, above, below, to the left, and to the right. If the computer cannot identify a 
nearest neighbor in any of these directions (i.e., the spot is on the edge of the array), the 
computer draws a line from the center of the spot to the nearest edge of the image. 

2. RESA and PLACE 

Once the location of an image area of interest is determined, an optical microscope can 
obtain a high resolution image at an appropriate wavelength to identify cellular features of 
interest. These features include the biomarker, also referred to as the "signal", the cells of 
interest within the tissue section (referred to as the "cell mask"), or a user defined location within 
the cell mask, also referred to as the "locale". The signal, the cell mask, and the locale are 
referred to as "channels". 

Referring to FIG. 4, a process 50 determines the region of interest in the images by 
developing a mask from the cell mask channel (step CI). Next, the process applies this mask to 
the locale and signal channels (step C2). The process then removes out-of-focus information 
from the masked images, for example, in a process of pseudo-deconvolution (step C3). Next, in 
a "pixel assignment" phase, the process identifies subcellular features in the image, assigning 
pixels in the image to the locales (step C4). Once the pixels are assigned, the computer maps the 
locales onto the signal image (step C5), and quantifies the amount of biomarker in each locale. 
This phase is referred to as "signal assignment". These steps are described in greater detail 
below. 

Masking 

During this process, the software identifies a region of interest in the image of the stained 
cells of interest (i.e., the cell mask channel). The software masks the locale and signal channels 
avoiding unnecessary analyses of areas outside the region of interest. 

To identify a region of interest, the computer determines a threshold intensity for the cell 
mask channel. Once determined, the computer redistributes the pixel intensities in a binary 
redistribution. In other words, the computer sets the intensity of each pixel below the threshold 
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to zero, and sets the remaining pixels to have the maximum intensity (e.g., for an 8-bit image the 
maximum intensity is 255). The set of pixel locations set to maximum intensity are referred to as 
the mask. Subsequent procedures on the other images in the image stack are performed on the 
pixel locations corresponding to the mask. 

The threshold intensity is related to the intensity of the background in the image, which 
the computer determines by first binning each pixel according to its intensity (e.g., in an 8-bit 
image each pixel will have an intensity from 0 to 255). In some embodiments, the background 
corresponds to the largest bin (i.e., the most common pixel intensity). In other embodiments, the 
background corresponds to the second largest bin. This occurs in some cases when the tissues 
autofluoresce and the largest bin corresponds to an area of fluorescing tissue instead of the 
fluorescing histochemical stains. In either case, the computer assumes that the background 
intensity is lower than a certain fraction of the maximum intensity (e.g., less than half the 
maximum intensity). 

Bin size is plotted versus intensity to yield a histogram. The maximum peak in the 
histogram corresponds to the largest bin. In embodiments where the largest bin corresponds to 
the background, the computer assigns the maximum peak intensity as the background intensity. 
In other embodiments, where the background corresponds to the second largest bin, the 
histogram has a second peak at a lower intensity than the maximum peak. So, if the second peak 
is at least a certain fraction of the size of the maximum peak (e.g., at least five percent), then the 
computer assigns the second peak intensity as the background intensity of the image. 

Once established, the computer adds an additional factor to the background intensity to 
determine the threshold intensity. For an 8-bit image, this factor equals D (l/5)/10 multiplied by 
a user defined input (usually 0.5). Here, D{ l / 5 ) is the quintile distribution of the binned pixels, 
which is determined as 

where {l) top20 is the mean pixel intensity of the pixels within the top 20 th percentile, and 
i 1 ) bottomio * s * e mean Pi xel intensity of pixels in the bottom 20 th percentile. 
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Pixels with intensity at or above the threshold intensity are assigned to the mask. 



The mask is then further modified according to user-defined parameters and image 
processing techniques. For example, the mask can be dilated or eroded so that the mask area 
matches a user-defined value, or have holes of a particular (user-defined) size within it filled. 
The user-defined parameters for creating the mask may be adjusted after analyzing a small 
number of sample histospot images, prior to running the entire array. 

After developing the mask, the computer applies the mask to the images in the image 
stack, identifying the region of interest in each of these images as the pixel locations 
corresponding to the mask pixel locations. 

Background Reduction 

As shown, the process 50 reduces C3 the impact of the out-of-focus information from the 
image. For example, the process 50 may use a pseudo deconvolution technique. While the 
pixels of the remaining image are reduced in intensity, the image information represents a thinner 
virtual slice through the top of the tissue. Furthermore, pseudo-deconvolution enhances the 
interfacial areas between the higher stain intensity and lower stain intensity areas of the image by 
increasing the contrast between these areas. 

The computer performs pseudo-deconvolution on the locale (cellular compartments) and 
signal (i.e., cellular components) channels. The computer first masks the images of these 
channels, reducing the number of pixels to be analyzed. The computer analyzes two images of 
each channel. The first image is an in-focus image (i.e., an image of the top of the histospot). The 
second image is a slightly out-of-focus image, produced by placing the focal plane slightly below 
the bottom of the tissue (e.g., for a five micron thick histospot, the focal plane of this image is 
located about eight microns below the top of the histospot). 

For each pixel location, the computer subtracts a percentage of the out-of-focus image 
pixel intensity, / 0 ut-of-focus> from the corresponding in-focus image pixel intensity, Tin-focus. The 
computer determines the adjusted pixel intensity, 7 new pixe i, using the quartile distribution, D(j/ 4 ) , 
of the in-focus image as follows: 



where 7 max is the maximum pixel intensity (e.g., 255 for an 8-bit image), and y/is calculated from 

y = ax£>0Q 

which was developed from an empiric assessment of a library of images Optical deconvolutions 
were judged visually and the ^for each was plotted versus the quartile distribution for the in- 
focus image. Regression analysis of the empiric data yielded values for the fitting-parameters 
(i.e., a is about 80 and (3 is about 1.19). The quartile distribution is determined from 

where {l) top2$ is the mean pixel intensity of the pixels within the top 25 th percentile, and 

{l) bottom25 is the mean pixel intensity of pixels in the bottom 25 th percentile. Conceptually, low 
intensity pixels in images with a low D(X) (i.e. a low signal to noise ratio) are subtracted less 
heavily than low intensity pixels from images with a high D(y 4 ) . 

The value of ^may be refined by determining the percent of signal intensity remaining 
after pseudo-deconvolution within the masked area and comparing it to a predefined value for 
that channel. If the percent is, for example, greater than the predefined value then the pseudo- 
deconvolution stops. Otherwise, the computer iteratively increases the value of j^until the 
predefined percent of signal intensity is reached. The predefined value is the expected 
percentage of the mask covered by a channel. 

After pseudo-deconvolution, each pixel of the resulting images is assigned to a locale in a 
process referred to as pixel assignment. 

Pixel Based Locale Assignment Compartmentalization of Expression (PLACE) 

During the pixel assignment phase, the computer assigns an identity based on the relative 
intensity of that pixel location in each of the locale channel images (i.e., the images of the stained 
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locales). For example, during this phase the computer decides for each pixel location in the 
image whether it belongs to the nucleus, the membrane, or the cytoplasm. The computer does 
not make an assignment to pixels that it cannot assign within a user-defined degree of confidence 
(e.g., 95%). Higher levels of confidence eliminate more pixels from the analysis. 

5 In general, for each pixel location in two locale images the computer reads a pixel 

intensity and compares each intensity value to a predetermined threshold intensity value. If the 
intensity value of only one locale is greater than the threshold, the computer assigns the pixel 
location to that locale. If both the intensity values are greater than their respective thresholds, the 
computer compares the intensity values from each locale, and assigns the identity of the locale 

;10 having the greater intensity to that pixel location. If both the pixel intensities are below their 

I threshold values, the computer assigns the pixel to a third locale. 

; After repeating the above for pixel locations in the images, the computer calculates the 

area of each locale, and compares the result to a predetermined (expected) coverage fraction. If 
the calculated coverage fraction (e.g., number of nuclear locale pixels/number of masked pixels) 

4 

{is is greater than the predetermined coverage fraction, then the computer removes the pixels having 
I the lowest intensity from the locale. The computer continues to remove the lowest intensity 

l pixels until the coverage fraction is reduced to about the predetermined coverage fraction. 

The following is an example of how this process works. The membrane locale and the 
nucleus locale images are selected for assignment analysis performed at 95% confidence 
20 interval. Pixel locations are assigned to the cytoplasm locale by exclusion. 

The computer reads pixel intensities at each pixel location in the membrane and nucleus 
locale images, and compares them to threshold values. If neither of the intensity values are 
greater than the threshold values, the pixel location is assigned to the cytoplasm locale. If only 
the nuclear intensity or membrane intensity is greater than the threshold value, the computer 
25 assigns the pixel location to the above-threshold locale. If both intensities are higher than the 

thresholds, computer compares the ratio of the intensity values to one, and makes an assignment 
as follows: 
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nuclear intensity , . 1 1 111 
> 1 -> pixel location = nuclear locale 



membrane intensity 
nuclear intensity 

membrane intensity 
nuclear intensity 

membrane intensity 



< 1 -» pixel location = membrane locale . 
= 1 -> pixel location = unassigned 



Thus, if the nuclear intensity is greater than the membrane intensity, the computer assigns 
the pixel location to the nuclear locale. If the membrane intensity is greater than the nuclear 
intensity, the computer assigns the pixel location to the membrane locale. If the membrane 
intensity is equal to the nuclear intensity, the pixel location is unassigned. This repeats for the 
pixel locations. 



Once all the pixel locations have been analyzed, the computer determines the amount of 
nuclear intensity incorrectly assigned to the membrane locale (i.e., nuclear to membrane spill- 
over), and vice versa. If the amount of nuclear intensity incorrectly assigned to the membrane 
10 channel is >5% of the total nuclear intensity, then the computer weights the nuclear intensity by a 
factor, iv, and recalculates the ratio of weighted nuclear intensity to membrane intensity. This 
ratio is compared to one, and pixel locations are reassigned as follows: 



f* 1 wx nuclear intensity „ . , , , 

■ > 1 -> pixel location = nuclear locale 



membrane intensity 
wx nuclear intensity 
membrane intensity 
wx nuclear intensity 
membrane intensity 



< 1 -» pixel location = membrane locale . 
= 1 -» pixel location = unassigned 



The computer again determines the amount of each locale incorrectly assigned. If this is 
15 still >5% the computer increases the value of w and reiterates the steps above. This continues 
until the amount of incorrectly assigned nuclear locale is <5%. The computer employs a similar 
technique to minimize the membrane-to-nuclear spillover. 

The computer also calculates the area of the cytoplasmic (exclusion) locale and compares 
it to a predetermined value. By iterating the assignment process, the computer ensures that there 
20 is <5% cytoplasmic-to-nuclear or cytoplasmic-to-membrane, as determined based on the biology. 
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The computer then evaluates the amount of signal in each locale during a "signal 
assignment" process. 

Following pixel assignment, the computer sums the signal in each locale. The computer 
reads the pixel intensity of the signal image (i.e., the image of the stain that selectively labels the 
cellular component), and adds together the signal intensity for pixel locations assigned to like 
subcellular compartments. The computer calculates a pixel intensity sum of a locale by the 
direct addition of the signal intensity of each pixel location assigned to that locale. The 
computer also calculates a sum of pixel intensity ratios by adding together the ratio of the signal 
intensity and the locale intensity for each pixel location. 

The pixel intensity sum and pixel intensity ratio sum is then used in calculating one or 
more parameters. For example, the computer determines the relative percentage of signal falling 
within each of the compartments (e.g. 30% of the total signal is membranous, 20% is 
cytoplasmic, and 50% is nuclear). In another example, the computer expresses the amount of 
signal present relative to the size of a particular compartment (e.g. the signal intensity of pixels 
assigned to the membrane channel divided by the number of pixels assigned to the membrane 
channel). The user may select to have the computer evaluate other parameters of interest. For 
example, how much of the image area is covered by the mask, how much of the mask is covered 
by each locale, etc. 

By implementing the pseudo-deconvolution algorithm (which limits the majority of 
extraneous pixel intensity) together with intensity area measurements (which further define the 
area of a particular sub-cellular locale), the computer is able to make highly accurate 
assignments of pixel locations sub-cellular locations. 

In some embodiments, the computer performs additional steps to better utilize the 
dynamic range of the camera. This is achieved by redistributing the pixel intensities in an image 
across the dynamic range of the detector based on their relative intensities. 

One form of redistribution is normalized redistribution, whereby the lower threshold (i.e., 
the pixel intensity of the background, determined during masking) is subtracted from all the 
pixels in the image, and any pixel with a resulting negative value is set to zero. Normalized 
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redistribution is used for the signal channel as this redistribution preserves the scale from one 
sample to the next, allowing direct comparisons to be made between samples. This is performed 
either after masking the signal image. 

Double-logarithmic redistribution sets all pixels in an image above 50% of the image's 
5 upper threshold (i.e., the value which only 50% of the pixels in the image have greater intensity) 
to the maximum intensity value (e.g., 255 for an 8-bit image). All pixels with intensity values 
below the lower threshold are set to 0, and all pixels with intensity values between the upper and 
lower thresholds are reassigned according to the formula: 

iog(/ old -zr) 

j neW I^log^UT^LTY 

h 0 where 7 n ew refers to the new pixel intensity, 7 0 id refers to the old pixel intensity, LTmdUT are the 
j lower and 50% maximum thresholds, respectively, and 7 max is the maximum intensity value. 

i Double-logarithmic redistribution is used for the locale channels, either after masking or after 
] pseudo-deconvolution of these channels. Conceptually, it ensures that pixels in locale images 
\ that have intensities above the 50 th percentile are assigned to their locale during the assignment 
H5 phase. Pixels with intensities below, but close to, the 50 th percentile are weighted more heavily 
j and are more likely to be assigned to the locale than pixels that have intensities well below the 

50 th percentile. 

Other user-defined redistributions, such as linear redistributions or other equation-based 
redistributions, may be used in addition to the above-described examples. 

20 Although the algorithms described above are with reference to analysis of tissue 

microarrays, they are not limited to studying only such arrays. The spotfinder algorithm may be 
used for identifying the location of any element comprising a collection and the RESA and 
PLACE algorithms may be used to localize and quantitate a biomarker within any imageable, 
cell containing sample, including tissue biopsies and cell containing fluid samples, such as blood, 

25 urine, spinal fluid, saliva, lymph, pleural fluid, peritoneal fluid and pericardial fluid. 
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Also, any optical or non-optical imaging device can be used, such as for example, upright 
or inverted optical microscopes, scanning confocal microscopes, cameras, scanning or tunneling 
electron microscopes, scanning probe microscopes, and imaging infrared detectors etc. 

In the embodiments described above, the computer can include hardware, software, or a 
combination of both to control the other components of the system and to analyze the images to 
extract the desired information about the histospots and tissue microarrays. The analysis 
described above is implemented in computer programs using standard programming techniques. 
Such programs are designed to execute on programmable computers each comprising a 
processor, a data storage system (including memory and/or storage elements), at least one input 
device, at least one output device, such as a display or printer. The program code is applied to 
input data (e.g., stitched together images or image stacks) to perform the functions described 
herein and generate information (e.g., localization of signal), which is applied to one or more 
output devices. Each computer program can be implemented in a high-level procedural or 
object-oriented programming language, or an assembly or machine language. Each such 
computer program can be stored on a computer readable storage medium (e.g., CD ROM or 
magnetic diskette) that when read by a computer can cause the processor in the computer to 
perform the analysis described herein. 

The following provides a detailed description of a specific embodiment of the preparation 
and analysis of tissue microarrays according to methods described herein, although similar steps 
could be performed with respect to any cell containing sample. Referring to FIG. 5, a tissue 
microarray 100 includes multiple samples of histospots 120 prepared from histocores embedded 
typically in a thin (e.g., about five microns) block of paraffin 130 at regular intervals, forming a 
series of rows and columns. Histospots (thin sections of histocores) 120 may be substantially 
disk-like in shape and will typically have the same thickness as the paraffin block 130 (i.e., about 
five microns) and a diameter of about 0.6 millimeters. Typically the centers of the histospots are 
spaced about a few tenths of a millimeter apart. Paraffin block 130 and histospots 120 may be 
mounted on a microscope slide 1 10. A tissue microarray 100 may include any number of 
histospots, typically on the order of several hundred to a few thousand. 

Referring to FIG. 6, an optical microscopy station can be used to obtain an appropriate 

image of the tissue. Microscopy station 200 includes an inverted optical microscope 201 for 
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imaging the tissue, and a computer 290 for analyzing the images. Optical microscope 201 
includes a mount 210, housing a light source 220, a sample stage 240, an objective lens 250 and 
a CCD camera 270. A frame grabber in computer 290 acquires the images through CCD camera 
270. 

Optical microscope 201 also includes filter wheels 230 and 260, which house a series of 
dichroic filters. The filters in wheel 230 allow selection of the appropriate illumination spectra 
for standard or fluorescent microscopy. Filters in wheel 260 filter the transmitted light for 
isolation of spectral signatures in fluorescent microscopy. Sample stage 240 supports and 
appropriately positions tissue microarray 100. Sample stage 240 can be linearly translated in the 
x, y, and z directions (axes are shown). Sample stage 240 includes motors to enable automated 
translation. Computer 290 controls sample stage 240 translation by servo control of the motors. 

A tissue microarray 100 can be imaged as follows: a user places the microarray on a 
sample stage 240. The user adjusts sample stage 240 so that the first (i.e., top-left) histospot is at 
the center of the field of view and focused on CCD camera 270. The objective lens 250 should 
be adjusted to the appropriate resolution, for example, a 0.6 millimeter histospot can be viewed 
at 10X magnification. Generally, the histospots correspond to areas of higher light intensity than 
the surrounding paraffin, as assessed through various means including signals derived from the 
visible light scattering of stained tissues, tissue autofluorescence or from a fluorescent tag. 
Computer 290 can acquire a low-resolution image (e.g. 64 pixel x 64 pixel with 16 bin 
resolution) using computer software (Softworx 2.5, Applied Precision, Issaquah, WA) and an 
imaging platform (e.g., Deltavision). Computer 290 automatically translates sample stage 240 
by an amount approximately equal to a field of view. The computer then acquires a second low- 
resolution image. This process is repeated until the computer has acquired images of the entire 
tissue microarray. Then, using commercially available software, the computer generates a 
composite image of the entire tissue microarray by stitching together the sequence of images like 
a patchwork. 

Biological markers, which may be detected in accordance with the present invention 

include, but are not limited to any nucleic acids, proteins, peptides, lipids, carbohydrates or other 

components of a cell. Certain markers are characteristic of particular cells, while other markers 

have been identified as being associated with a particular disease or condition. Examples of 
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known prognostic markers include enzymatic markers such as galactosyl transferase II, neuron 
specific enolase, proton ATPase-2, and acid phosphatase. Hormone or hormone receptor 
markers include human chorionic gonadotropin (HCG), adrenocorticotropic hormone, 
carcinoembryonic antigen (CEA), prostate-specific antigen (PSA), estrogen receptor, 
progesterone receptor, androgen receptor, gClq-R/p33 complement receptor, IL-2 receptor, p75 
neurotrophin receptor, PTH receptor, thyroid hormone receptor, and insulin receptor. 

Lymphoid markers include alpha- 1-antichymotrypsin, alpha- 1 -antitrypsin, B cell marker, 
bcl-2, bcl-6, B lymphocyte antigen 36kD, BM1 (myeloid marker), BM2 (myeloid marker), 
galectin-3, granzyme B, HLA class I Antigen, HLA class II (DP) antigen, HLA class II (DQ) 
antigen, HLA class II (DR) antigen, human neutrophil defensins, immunoglobulin A, 
immunoglobulin D, immunoglobulin G, immunoglobulin M, kappa light chain, kappa light 
chain, lambda light chain, lymphocyte/histocyte antigen, macrophage marker, muramidase 
(lysozyme), p80 anaplastic lymphoma kinase, plasma cell marker, secretory leukocyte protease 
inhibitor, T cell antigen receptor (JO VI 1), T cell antigen receptor (JOVI 3), terminal 
deoxynucleotidyl transferase, unclustered B cell marker. 

Tumour markers include alpha fetoprotein, apolipoprotein D, BAG-1 (RAP46 protein), 
CA19-9 (sialyl lewisa), CA50 (carcinoma associated mucin antigen), CA125 (ovarian cancer 
antigen), CA242 (tumour associated mucin antigen), chromogranin A, clusterin (apolipoprotein 
J), epithelial membrane antigen, epithelial-related antigen, epithelial specific antigen, gross 
cystic disease fluid protein-15, hepatocyte specific antigen, heregulin, human gastric mucin, 
human milk fat globule, MAGE-1, matrix metalloproteinases, melan A, melanoma marker 
(HMB45), mesothelin, metallothionein, microphthalmia transcription factor (MITF), Muc-1 core 
glycoprotein. Muc-1 glycoprotein, Muc-2 glycoprotein, Muc-5AC glycoprotein, Muc-6 
glycoprotein, myeloperoxidase, Myf-3 (Rhabdomyosarcoma marker), Myf-4 
(Rhabdomyosarcoma marker), MyoDl (Rhabdomyosarcoma marker), myoglobin, nm23 protein, 
placental alkaline phosphatase, prealbumin, prostate specific antigen, prostatic acid phosphatase, 
prostatic inhibin peptide, PTEN, renal cell carcinoma marker, small intestinal mucinous antigen, 
tetranectin, thyroid transcription factor- 1, tissue inhibitor of matrix metalloproteinase 1, tissue 
inhibitor of matrix metalloproteinase 2, tyrosinase, tyrosinase-related protein- 1, villin, von 
Willebrand factor. 
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Cell cycle associated markers include apoptosis protease activating factor- 1, bcl-w , bcl- 
x, bromodeoxyuridine, CAK (cdk-activating kinase), cellular apoptosis susceptibility protein 
(CAS), caspase 2, caspase 8, CPP32 (caspase-3), CPP32 (caspase-3), cyclin dependent kinases, 
cyclin A, cyclin Bl, cyclin Dl, cyclin D2, cyclin D3, cyclin E, cyclin G, DNA fragmentation 
factor (N-terminus), Fas (CD95), Fas-associated death domain protein, Fas ligand, Fen-1, DPO- 
38, Mcl-1, minichromosome maintenance proteins, mismatch repair protein (MSH2), poly 
(ADP-Ribose) polymerase, proliferating cell nuclear antigen, pl6 protein, p27 protein, p34cdc2, 
p57 protein (Kip2), pl05 protein, Stat 1 alpha, topoisomerase I, topoisomerase II alpha, 
topoisomerase III alpha, topoisomerase II beta. 

Neural tissue and tumour markers include alpha B crystallin, alpha-internexin, alpha 
synuclein, amyloid precursor protein, beta amyloid, calbindin, choline acetyltransferase, 
excitatory amino acid transporter 1, GAP43, glial fibrillary acidic protein, glutamate receptor 2, 
myelin basic protein, nerve growth factor receptor (gp75), neuroblastoma marker, neurofilament 
68kD, neurofilament 160kD, neurofilament 200kD, neuron specific enolase, nicotinic 
acetylcholine receptor alpha4, nicotinic acetylcholine receptor beta2, peripherin, protein gene 
product 9, S-100 protein, serotonin, SNAP-25, synapsin I, synaptophysin, tau, tryptophan 
hydroxylase, tyrosine hydroxylase, ubiquitin. 

Cluster differentiation markers include CDla, CDlb, CDlc, CDld, CDle, CD2, 
CD3delta, CD3epsilon, CD3gamma, CD4, CD5, CD6, CD7, CD8alpha, CD8beta, CD9, CD10, 
CDlla, CDllb, CDllc, CDwl2, CD13, CD14, CD15, CD15s, CD16a, CD16b, CDwl7, CD18, 
CD19, CD20, CD21,CD22, CD23, CD24, CD25, CD26, CD27, CD28, CD29, CD30, CD31, 
CD32, CD33, CD34, CD35, CD36, CD37, CD38, CD39, CD40, CD41, CD42a, CD42b, CD42c, 
CD42d, CD43, CD44, CD44R, CD45, CD46, CD47, CD48, CD49a, CD49b, CD49c, CD49d, 
CD49e, CD49f, CD50, CD51, CD52, CD53, CD54, CD55, CD56, CD57, CD58, CD59, CDw60, 
CD61, CD62E, CD62L, CD62P, CD63, CD64, CD65, CD65s, CD66a, CD66b, CD66c, CD66d, 
CD66e, CD66f, CD68, CD69, CD70, CD71, CD72, CD73, CD74, CDw75, CDw76, CD77, 
CD79a, CD79b, CD80, CD81, CD82, CD83, CD84, CD85, CD86, CD87, CD88, CD89, CD90, 
CD91, CDw92, CDw93, CD94, CD95, CD96, CD97, CD98, CD99, CD100, CD101, CD102, 
CD103, CD104, CD105, CD106, CD107a, CD107b, CDwl08, CD109, CD114, CD115, CD116, 
CD117, CDwll9, CD120a, CD120b, CD121a, CDwl21b, CD122, CD123, CD124, CDwl25, 
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CD126, CD127, CDwl28a, CDwl28b, CD130, CDwl31, CD132, CD134, CD135, CDwl36, 
CDwl37, CD138, CD139, CD140a, CD140b, CD141, CD142, CD143, CD144, CDwl45, 
CD146, CD147, CD148. CDwl49, CDwl50, CD151, CD152, CD153, CD154, CD155, CD156, 
CD157, CD158a, CD158b, CD161, CD162, CD163, CD164, CD165, CD166, and TCR-zeta. 

Other cellular markers include centromere protein-F (CENP-F), giantin, involucrin, lamin 
A&C [XB10], LAP-70, mucin, nuclear pore complex proteins, pl80 lamellar body protein, ran, 
r, cathepsin D, Ps2 protein, Her2-neu, P53, SI 00, epithelial marker antigen (EMA), TdT, MB2, 
MB3, PCNA,andKi67. 

Cell containing samples may be stained using dyes or stains, or histochemicals, that 
directly react with the specific biomarkers or with various types of cells or subcellular 
compartments. Not all stains are compatible. Therefore the type of stains employed and their 
sequence of application should be well considered, but can be readily determined by one of skill 
in the art. Such histochemicals may be chromophores detectable by transmittance microscopy or 
fluorophores detectable by fluorescence microscopy. In general, a cell containing samples may 
be incubated with a solution comprising at least one histochemical, which will directly react with 
or bind to chemical groups of the target. Some histochemicals must be co-incubated with a 
mordant, or metal, in order to allow staining. A cell containing sample may be incubated with a 
mixture of at least one histochemical that stains a component of interest and another 
histochemical that acts as a counterstain and binds a region outside the component of interest. 
Alternatively , mixtures of multiple probes may be used in the staining, and provide a way to 
identify the positions of specific probes. 

The following, non-limiting list provides exemplary chromophores that may be used as 
histological stains or counterstains and their target cells, subcellular compartments, or cellular 
components: Eosin (alkaline cellular components, cytoplasm), Hematoxylin (nucleic acids), 
Orange G (red blood, pancreas, and pituitary cells), Light Green SF (collagen), Romanowsky- 
Giemsa (overall cell morphology), May-Grunwald (blood cells), Blue Counterstain (Trevigen), 
Ethyl Green (CAS) (amyloid), Feulgen-Naphthol Yellow S (DNA), Giemsa (differentially stains 
various cellular compartments), Methyl Green (amyloid), pyronin (nucleic acids), Naphthol- 
Yellow (red blood cells), Neutral Red (nuclei), Papanicolaou stain (which typically includes a 
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mixture of Hematoxylin, Eosin Y, Orange G and Bismarck Brown mixture (overall cell 
morphology), Red Counterstain B (Trevigen), Red Counterstain C (Trevigen),Sirius Red 
(amyloid), Feulgen reagent (pararosanilin) (DNA), Gallocyanin chrom-alum (DNA), 
Gallocyanin chrom-alum and Naphthol Yellow S (DNA), Methyl Green-Pyronin Y (DNA), 
Thionin-Feulgen reagent (DNA), Acridine Orange (DNA), Methylene Blue (RNA and DNA), 
Toluidine Blue (RNA and DNA), Alcian blue (carbohydrates), Ruthenium Red (carbohydrates), 
Sudan Black (lipids), Sudan IV (lipids), Oil Red-0 (lipids), Van Gieson's trichrome stain (acid 
fuchsin and picric acid mixture ) (muscle cells), Masson trichrome stain (hematoxylin, acid 
fuchsin, and Light Green mixture) (stains collagen, cytoplasm, nucleioli differently), Aldehyde 
Fuchsin (elastin fibers), and Weigert stain (differentiates reticular and collagenous fibers). A 
comprehensive list of such stains, their description, and general use is given in R.D. Lillie, 
"Conn's Biological Stains", 8th ed., Williams and Wilkins Company, Baltimore, Maryland 
(1969). Suitable mordants and compositions of the preceding are well-known to one of skill in 
the art. 

The following, non-limiting list provides exemplary fluorescent histological stains and 
their target cells, subcellular compartments, or cellular components if applicable: 4',6- 
diamidino-2-phenylindole (DAPI) (nucleic acids), Eosin (alkaline cellular components, 
cytoplasm), Hoechst 33258 and Hoechst 33342 (two bisbenzimides) (nucleic acids) , Propidium 
Iodide (nucleic acids), Spectrum Orange (nucleic acids), Spectrum Green (nucleic acids), 
Quinacrine (nucleic acids), Fluorescein-phalloidin (actin fibers), Chromomycin A 3 (nucleic 
acids), Acriflavine-Feulgen reaction (nucleic acid), Auramine O-Feulgen reaction (nucleic 
acids), Ethidium Bromide (nucleic acids). Nissl stains (neurons), high affinity DNA fluorophores 
such as POPO, BOBO, YOYO and TOTO and others, and Green Fluorescent Protein fused to 
DNA binding protein, such as histones, ACMA, Quinacrine and Acridine Orange. 

A wide variety of proprietary fluorescent organelle-specific probes are available from 
Molecular Probes (Eugene, OR), which include mitochondria-specific probes (MitoFluor and 
MitoTracker dyes), endoplasmic reticulum (ER) and Golgi probes (ER-Tracker and various 
ceramide conjugates), and lysosomal probes (LysoTracker dyes). These probes, as well as many 
nonproprietary fluorescent histochemicals, are available from and extensively described in the 
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Handbook of Fluorescent Probes and Research Products 8 Ed. (2001), available from 
Molecular Probes, Eugene, OR. 

Each cell containing sample may be co-incubated with appropriate substrates for an 
enzyme that is a cellular component of interest and appropriate reagents that yield colored 
precipitates at the sites of enzyme activity. Such enzyme histochemical stains are specific for the 
particular target enzyme. Staining with enzyme histochemical stains may be used to define a 
subcellular component or a particular type of cell. Alternatively, enzyme histochemical stains 
may be used diagnostically to quantitate the amount of enzyme activity in cells. A wide variety 
of enzymatic substrates and detection assays are known and described in the art, and some 
selected methods are exemplified below. 

Acid phosphatases may be detected through several methods. In the Gomori method for 
acid phophatase, a cell preparation is incubated with glycerophosphate and lead nitrate. The 
enzyme liberates phosphate, which combines with lead to produce lead phosphate, a colorless 
precipitate. The tissue is then immersed in a solution of ammonium sulfide, which reacts with 
lead phosphate to form lead sulfide, a black precipitate. Alternatively, cells may be incubated 
with a solution comprising pararosanilin-HCl, sodium nitrite, napthol ASB1 phosphate 
(substrate), and veronal acetate buffer. This method produces a red precipitate in the areas of 
acid phosphatase activity. Owing to their characteristic content of acid phosphatase, lysosomes 
can be distinguished from other cytoplasmic granules and organelles through the use of this 
assay. 

Dehydrogenases may be localized by incubating cells with an appropriate substrate for 
the species of dehydrogenase and tetrazole. The enzyme transfers hydrogen ions from the 
substrate to tetrazole, reducing tetrazole to formazan, a dark precipitate. For example, NADH 
dehydrogenase is a component of complex I of the respiratory chain and is localized 
predominantly to the mitochondria. 

Other enzymes for which well-known staining techniques have been developed, and their 
primary cellular locations or activities, include but are not limited to the following: ATPases 
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(muscle fibers), succinate dehydrogenases (mitochondria), cytochrome c oxidases 
(mitochondria), phosphorylases (mitochondria), phosphofructokinases (mitochondria), acetyl 
cholinesterases (nerve cells), lactases (small intestine), leucine aminopeptidases (liver cells), 
myodenylate deaminases (muscle cells), NADH diaphorases (erythrocytes), and sucrases (small 
intestine). 

Immunohistochemistry is among the most sensitive and specific histochemical 
techniques. Each histospot may be combined with a labeled binding composition comprising a 
specifically binding probe. Various labels may be employed, such as fluorophores, or enzymes 
which produce a product which absorbs light or fluoresces. A wide variety of labels are known 
which provide for strong signals in relation to a single binding event. Multiple probes used in 
the staining may be labeled with more than one distinguishable fluorescent label. These color 
differences provide a way to identify the positions of specific probes. The method of preparing 
conjugates of fluorophores and proteins, such as antibodies, is extensively described in the 
literature and does not require exemplification here. 

Although there are at least 120,000 commercially available antibodies, the following lists 
some exemplary primary antibodies known to specifically bind cellular components and which 
are presently employed as components in immunohistochemical stains used for research and, in 
limited cases, for diagnosis of various diseases. Anti-estrogen receptor antibody (breast cancer), 
anti-progesterone receptor antibody (breast cancer), anti-p53 antibody (multiple cancers), anti- 
Her-2/neu antibody (multiple cancers), anti-EGFR antibody (epidermal growth factor, multiple 
cancers), anti-cathepsin D antibody (breast and other cancers), anti-Bcl-2 antibody (apoptotic 
cells), anti- E-cadherin antibody, anti-CA125 antibody (ovarian and other cancers), anti-CA15-3 
antibody (breast cancer), anti-CA19-9 antibody (colon cancer), anti-c-erbB-2 antibody, anti-P- 
glycoprotein antibody (MDR, multi-drug resistance), anti-CEA antibody (carcinoembryonic 
antigen), anti-retinoblastoma protein (Rb) antibody, anti-ras oneoprotein (p21) antibody, anti- 
Lewis X (also called CD 15) antibody, anti-Ki-67 antibody (cellular proliferation), anti-PCNA 
(multiple cancers) antibody, anti-CD3 antibody (T-cells), anti-CD4 antibody (helper T cells), 
anti-CD5 antibody (T cells), anti-CD7 antibody (thymocytes, immature T cells, NK killer cells), 
anti-CD8 antibody (suppressor T cells), anti-CD9/p24 antibody (ALL), anti-CDIO (also called 
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CALLA) antibody (common acute lymphoblasic leukemia), anti-CDllc antibody (Monocytes, 
granulocytes, AML), anti-CD 13 antibody (myelomonocytic cells, AML), anti-CD 14 antibody 
(mature monocytes, granulocytes), anti-CD 15 antibody (Hodgkin's disease), anti-CD 19 antibody 
(B cells), anti-CD20 antibody (B cells), anti-CD22 antibody (B cells), anti-CD23 antibody 
(activated B cells, CLL), anti-CD30 antibody (activated T and B cells, Hodgkin's disease), anti- 
CD31 antibody (angiogenesis marker), anti-CD33 antibody (myeloid cells, AML), anti-CD34 
antibody (endothelial stem cells, stromal tumors), anti-CD35 antibody (dendritic cells), anti- 
CD38 antibody (plasma cells, activated T, B, and myeloid cells), anti-CD41 antibody (platelets, 
megakaryocytes), anti-LCA/CD45 antibody (leukocyte common antigen), anti-CD45RO 
antibody (helper, inducer T cells), anti-CD45RA antibody (B cells), anti-CD39, CD 100 antibody, 
anti-CD95/Fas antibody (apoptosis), anti-CD99 antibody (Ewings Sarcoma marker, MIC2 gene 
product), anti-CD 106 antibody (VCAM-1; activated endothelial cells), anti-ubiquitin antibody 
(Alzheimer's disease), anti-CD71 (transferrin receptor) antibody, anti-c-myc (oncoprotein and a 
hapten) antibody, anti-cytokeratins (transferrin receptor) antibody, anti-vimentins (endothelial 
cells) antibody (B and T cells), anti-HP V proteins (human papillomavirus) antibody, anti-kappa 
light chains antibody (B cell), anti-lambda light chains antibody (B cell), anti-melanosomes 
(HMB45) antibody (melanoma), anti-prostate specific antigen (PSA) antibody (prostate cancer), 
anti-S-100 antibody (melanoma, salvary, glial cells), anti-tau antigen antibody (Alzheimer's 
disease), anti- fibrin antibody (epithelial cells), anti-keratins antibody, anti-cytokeratin antibody 
(tumor), anti-alpha-catenin (cell membrane), and anti-Tn-antigen antibody (colon carcinoma, 
adenocarcinomas, and pancreatic cancer). 

Fluorophores that may be conjugated to a primary antibody include but are not limited to 
Fluorescein, Rhodamine, Texas Red, Cy2, Cy3, Cy5, VECTOR Red, ELF.TM. (Enzyme-Labeled 
Fluorescence), CyO, Cy0.5, Cyl, Cyl.5, Cy3, Cy3.5, Cy5, Cy7, FluorX, Calcein, Calcein-AM, 
CRYPTOFLUOR.TM/S, Orange (42 kDa), Tangerine (35 kDa), Gold (31 kDa), Red (42 kDa), 
Crimson (40 kDa), BHMP, BHDMAP, Br-Oregon, Lucifer Yellow, Alexa dye family, N-[6-(7- 
nitrobenz-2-oxa-l, 3-diazol-4-yl)amino]caproyl] (NBD), BODIPY.TM., boron dipyrromethene 
difluoride, Oregon Green, MITOTRACKER.TM. Red, DiOC.sub.7 (3), DiIC.sub.18, 
Phycoerythrin, Phycobiliproteins BPE (240 kDa) RPE (240 kDa) CPC (264 kDa) APC (104 
kDa), Spectrum Blue, Spectrum Aqua, Spectrum Green, Spectrum Gold, Spectrum Orange, 
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Spectrum Red, NADH, NADPH, FAD, Infra-Red (IR) Dyes, Cyclic GDP-Ribose (cGDPR), 
Calcofluor White, Lissamine, Umbelliferone, Tyrosine and Tryptophan. A wide variety of other 
fluorescent probes are available from and/or extensively described in the Handbook of 
Fluorescent Probes and Research Products 8 th Ed. (2001), available from Molecular Probes, 
Eugene, OR., as well as many other manufacturers. 

Further amplification of the signal can be achieved by using combinations of specific 
binding members, such as antibodies and anti-antibodies, where the anti-antibodies bind to a 
conserved region of the target antibody probe, particularly where the antibodies are from 
different species. Alternatively specific binding ligand-receptor pairs, such as biotin- 
streptavidin, may be used, where the primary antibody is conjugated to one member of the pair 
and the other member is labeled with a detectable probe. Thus, one effectively builds a sandwich 
of binding members, where the first binding member binds to the cellular component and serves 
to provide for secondary binding, where the secondary binding member may or may not include 
a label, which may further provide for tertiary binding where the tertiary binding member will 
provide a label. 

The secondary antibody, avidin, strepavidin or biotin are each independently labeled with 
a detectable moiety, which can be an enzyme directing a colorimetric reaction of a substrate 
having a substantially non-soluble color reaction product, a fluorescent dye (stain), a luminescent 
dye or a non- fluorescent dye. Examples concerning each of these options are listed below. 

In principle, any enzyme that (i) can be conjugated to or bind indirectly to (e.g., via 
conjugated avidin, strepavidin, biotin, secondary antibody) a primary antibody, and (ii) uses a 
soluble substrate to provide an insoluble product (precipitate) could be used. 

The enzyme employed can be, for example, alkaline phosphatase, horseradish peroxidase, 
beta-galactosidase and/or glucose oxidase; and the substrate can respectively be an alkaline 
phosphatase, horseradish peroxidase, beta.-galactosidase or glucose oxidase substrate. 
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Alkaline phosphatase (AP) substrates include, but are not limited to, AP-Blue substrate 
(blue precipitate, Zymed catalog p. 61); AP-Orange substrate (orange, precipitate, Zymed), AP- 
Red substrate (red, red precipitate, Zymed), 5-bromo, 4-chloro, 3-indolyphosphate (BCEP 
substrate, turquoise precipitate), 5-bromo, 4-chloro, 3-indolyl phosphate/nitroblue tetrazolium/ 
iodonitrotetrazolium (BCIP/INT substrate, yellow-brown precipitate, Biomeda), 5-bromo, 4- 
chloro, 3-indolyphosphate/nitroblue tetrazolium (BCIP/NBT substrate, blue/purple), 5-bromo, 4- 
chloro, 3-indolyl phosphate/nitroblue tetrazolium/iodonitrotetrazolium (BCIP/NBT/INT, brown 
precipitate, DAKO, Fast Red (Red), Magenta-phos (magenta), Naphthol AS-BI-phosphate 
(NABP)ZFast Red TR (Red), Naphthol AS-BI-phosphate (NABP)/New Fuchsin (Red), Naphthol 
AS-MX-phosphate (NAMP)/New Fuchsin (Red), New Fuchsin AP substrate (red), p- 
Nitrophenyl phosphate (PNPP, Yellow, water soluble), VECTORTM Black (black), 
VECTOR. TM. Blue (blue), VECTOR.TM. Red (red), Vega Red (raspberry red color). 

Horseradish Peroxidase (HRP, sometimes abbreviated PO) substrates include, but are not 
limited to, 2,2' Azino-di-3-ethylbenz-thiazoline sulfonate (ABTS, green, water soluble), 
aminoethyl carbazole, 3 -amino, 9-ethylcarbazole AEC (3A9EC, red). Alpha-naphthol pyronin 
(red), 4-chloro- 1 -naphthol (4C1N, blue, blue-black), 3,3'-diaminobenzidine tetrahydrochloride 
(DAB, brown), ortho-dianisidine (green), o-phenylene diamine (OPD, brown, water soluble), 
TACS Blue (blue), TACS Red (red), 3,3^5,5Tetramethylbenzidine (TMB, green or green/blue), 
TRUE BLUE.TM. (blue), VECTOR.TM. VIP (purple), VECTORTM. SG (smoky blue-gray), 
and Zymed Blue HRP substrate (vivid blue). 

Glucose oxidase (GO) substrates, include, but are not limited to, nitroblue tetrazolium 
(NBT, purple precipitate), tetranitroblue tetrazolium (TNBT, black precipitate), 2-(4- 
iodophenyl)-5-(4-nitorphenyl)-3-phenyltetrazolium chloride (INT, red or orange precipitate), 
Tetrazolium blue (blue), Nitrotetrazolium violet (violet), and 3-(4,5-dimethylthiazol-2-yl)-2,5- 
diphenyltetrazolium bromide (MTT, purple). All tetrazolium substrates require glucose as a co- 
substrate. The glucose gets oxidized and the tetrazolium salt gets reduced and forms an insoluble 
formazan which forms the color precipitate. 
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Beta-galactosidase substrates, include, but are not limited to, 5-bromo-4-chloro-3-indoyl 
beta-D-galactopyranoside (X-gal, blue precipitate). The precipitates associated with each of the 
substrates listed have unique detectable spectral signatures (components). 

The enzyme can also be directed at catalyzing a luminescence reaction of a substrate, 
such as, but not limited to, luciferase and aequorin, having a substantially non-soluble reaction 
product capable of luminescencing or of directing a second reaction of a second substrate, such 
as but not limited to, luciferine and ATP or coelenterazine and Ca.sup.++, having a 
luminescencing product. 

The following references, which are incorporated herein provide additional examples. 
J.M Elias (1990) Immunohistopathology: A practical approach to diagnosis. ASCP Press 
(American Society of Clinical Pathologists), Chicago; J. F. McGinty, F. E. Bloom (1983) Double 
immunostaining reveals distinctions among opioid peptidergic neurons in the medial basal 
hypothalamus. Brain Res. 278: 145-153; and T. Jowett (1997) Tissue In situ Hybridization: 
Methods in Animal Development. John Wiley & Sons, Inc., New York; J Histochem Cytochem 
1997 December 45(12):1629-1641. 

Cellular preparations may be subjected to in-situ hybridization (ISH). In general, a 
nucleic acid sequence probe is synthesized and labeled with either a fluorescent probe or one 
member of a ligand:receptor pair, such as biotin/avidin, labeled with a detectable moiety. 
Exemplary probes and moieties are described in the preceding section. The sequence probe is 
complementary to a target nucleotide sequence in the cell. Each cell or cellular compartment 
containing the target nucleotide sequence may bind the labeled probe. Probes used in the 
analysis may be either DNA or RNA oligonucleotides or polynucleotides and may contain not 
only naturally occurring nucleotides but their analogs such as dioxygenin dCTP, biotin dcTP 7- 
azaguanosine, azidothymidine, inosine, or uridine. Other useful probes include peptide probes 
and analogues thereof, branched gene DNA, peptidomimetics, peptide nucleic acids, and/or 
antibodies. Probes should have sufficient complementarity to the target nucleic acid sequence of 
interest so that stable and specific binding occurs between the target nucleic acid sequence and 
the probe. The degree of homology required for stable hybridization varies with the stringency 
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of the hybridization. Conventional methodologies for ISH, hybridization and probe selection are 
described in Leitch, et al. In Situ Hybridization: a practical guide, Oxford BIOS Scientific 
Publishers, Microscopy Handbooks v. 27 (1994); and Sambrook, J., Fritsch, E.F., Maniatis, T., 
Molecular Cloning: A Laboratory Manual, Cold Spring Harbor Press (1989). 

The present invention is further illustrated by the following examples, which should not 
be construed as limiting in any way. The contents of all cited references are hereby expressly 
incorporated by reference. 

Example 1. Construction of Tissue Microarrays for a Survival Analysis of The Estrogen 
Receptor (ER) and HER2/neu and for Analysis of Nuclear Associated Beta-catenin 

Tissue microarrav design : Paraffin-embedded formalin-fixed specimens from 345 cases 
of node-positive invasive breast carcinoma were identified. Areas of invasive carcinoma, away 
from in situ lesions and normal epithelium, were identified and three 0.6cm punch "biopsy" 
cores were taken from separate areas. Each core was arrayed into a separate recipient block, and 
five-micron thick sections were cut and processed as previously described (Konenen, J. et al., 
Tissue microarrays for high-throughput molecular profiling of tumor specimens, (1987) Nat 
Med. 4:844-7). Similarly, 310 cases of colon carcinoma were obtained and arrayed, as previously 
described (Chung, G.G. et al, Clin. Cancer Res. (In Press)). 

Immunohistochemistry : Pre-cut paraffin-coated tissue microarray slides were 
deparaffmized and antigen-retrieved by pressure-cooking (Katoh, A.K. et al.,(1997) Biotech 
Histochem. F2:291-8). Slides were stained with antibodies to one of three target antigens: 
monoclonal anti-E.R. (mouse, Dako Corporation, Carpinteria, CA), polyclonal anti-HER2/neu 
(rabbit, Dako Corp.), monoclonal (mouse clone 14, BD Transduction Labs, San Diego CA) anti- 
beta-catenin, or polyclonal rabbit anti-betacatenin. Primaries were incubated overnight at 4°C. A 
corresponding goat antimouse or anti-rabbit secondary antibody conjugated to a horseradish 
peroxidase decorated dextran-polymer backbone was then applied for 1 hr (Envision, DAKO 
Corp.). Target antigens were either visualized with a visible light chromagen 
(Diaminobenzidine, DAKO) for visual analysis, or a fluorescent chromagen (Cy-5-tyramide, 
NEN Life Science Products, Boston, MA). Slides designated for automated analysis were 
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counterstained with DAPI for visualization of nuclei, and either polyclonal rabbit anticytokeratin 
(Zymed, So. San Francisco, CA) or rabbit anti-alpha-catenin (?) to distinguish between tumor 
cells and stroma as well as to visualize the cell membrane. In many cases, exponentially 
subtracted images of histospots stained with anti-cytokeratin provided an acceptable marker for 
the cell membrane due to the sub-membranous coalescence of cytokeratin in tumor cells. These 
antibodies were visualized using either Cy3- or Alexa 488-conjugated goat anti-mouse or anti- 
rabbit secondary antibodies (Amersham, Piscataway, NJ and Molecular Probes, Eugene, OR). 
Slides designated for visual inspection were counterstained with ammonium hydroxide acidified 
hematoxylin. Manual examination of microarrays for E.R., HER2/neu, and beta-catenin levels 
has been previously described (Snead, D.R. et aL,(1993) Histopathology 25:233-8). 

Image analysis : Images of microarrays were obtained using a Deltavision platform and 
software (SoftWorx 2.5) (Applied Precision, Issaquah, WA), with an attached water-cooled 
Photometries series 300 camera through a lOx Nikon Super-Fluor lens on a TE200 inverted 
fluorescent microscope with automated X,Y,Z stage movement. Low power images of 
microarrays were stitched together using multiple (-1500) low resolution images of the 
microarray (64x64 pixel). These images were analyzed by software algorithms described herein 
to determine the location of each . Subsequently, monochromatic, high resolution (1024x1024 
pixel) images were obtained of each , both in the plane of focus and 8 microns below it. Image 
pairs for each fluorescent dye were obtained. Images were analyzed using additional algorithms 
as follows, in brief. Regions of interest (tumor) were identified using a mask derived from a 
ubiquitously-expressed epithelial-specific antigen (either cytokeratin or alpha-catenin). Images 
of fluorescently-tagged membrane and nuclear compartments were exponentially subtracted until 
a set amount of image intensity remained. Images were then combined so that there was minimal 
overlap of signal from one compartment to the next. Pixels in which a significant degree of 
overlap was present were negated from further analysis. The pixel intensity of exponentially 
subtracted images of the target antigen were assigned to one of three compartments: nuclear, 
membrane, or non-nuclear non-membrane (cytoplasm). Target intensities were analyzed as 
described below. For E.R. only nuclear-localized signal was used, for HER2/neu only 
membrane-localized signal was analyzed. For beta-catenin total signal, the ratio of nuclear to 
membrane signal, and the ratio of nuclear to total signal was analyzed. 
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Data analysis : staining scores from the breast cancers represent the averaged (for ER) or 
maximized (for HER2/neu) results from two scorable histospots. Subsequent studies revealed 
that analysis of a single histospot could provide significant statistical power to judge outcomes, 
so that staining scores from the colon cancer array represent the result of only one histospot. 
Overall survival analysis was assessed using Kaplan-Meier analysis and the Mantel-Cox log rank 
score for assessing statistical significance. Relative risk was assessed using the univariate 
Coxproportional hazards model Analyses were performed using Statview 5.0.1 (SAS Institute, 
CaryNC). 
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